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(54) Method and apparatus for allocating functional units in a multithreated VLIW processor 



(57) A method and apparatus are disclosed for alio- 
eating functional units in a multithreaded very iarge in- 
struction word (VLIW) processor. The present invention 
combines the techniques of conventional VLIW archi- 
tectures and conventional multithreaded architectures 
to reduce execution time within an individual program, 
as well as across a workload. The present invention uti- 
lizes acompilerto detect parallelism. The disclosed mul- 
tithreaded VLIW architecture exploits program parallel- 
ism by issuing multiple instructions, in a similar manner 
to single threaded VLIW processors, from a single pro- 
gram sequencer, and also supports multiple program 
sequencers, as in simultaneous multithreading. Instruc- 
tions are allocated to functional units to issue multiple 
VLIW instructions to multiple functional units in the same 
cycle. The allocation mechanism of the present inven- 



tion occupies a pipeline stage just before arguments are 
dispatched to functional units. The allocate stage deter- 
mines how to group the instructions together to maxi- 
mize efficiency, by selecting appropriate instructions 
and assigning the instructions to the FUs. The criteria 
for selection are thread priority or resource availability 
or both. Under the thread priority criteria, different 
threads can have different priorities. The allocate stage 
selects and forwards the packets (or instructions from 
packets) for execution belonging to the thread with the 
highest priority according to the priority policy imple- 
mented. Under the resource availability criteria, a pack- 
et (having up to K instructions) can be allocated only if 
the resources (functional units) required by the packet 
are available for the next cycle. Functional units report 
their availability to the allocate stage. 
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Description 

Cross-Reference to Related Applications 

[0001] The present invention is related to United 5 
States Patent Application entitled "Method and Appara- 
tus for Releasing Functional Units in a Multithreaded 
Very Large Instruction Word (VLIW) Processor," Attor- 
ney Docket Number (Berenbaum 8-3-4-4); United 
States Patent Application entitled "Method and Appara- 10 
tus for Splitting Packets in a Multithreaded Very Large 
Instruction Word (VLIW) Processor," Attorney Docket 
Number (Berenbaum 9-4-5-5); and United States Pat- 
ent Application entitled "Method and Apparatus for Iden- 
tifying Splittable Packets in a Multithreaded Very Large « 
Instruction Word (VLIW) Processor," Attorney Docket 
Number (Berenbaum 10-5-6-6), each filed contempora- 
neously herewith, assigned to the assignee of the 
present invention and incorporated by reference herein. 

20 

Field of the Invention 

[0002] The present invention relates generally to mul- 
tithreaded processors, and, more particularly, to a meth- 
od and apparatus for allocating functional units in such 25 
multithreaded processors. 

Background of the Invention 

[0003] Computer architecture designs attempt to 30 
complete workloads more quickly. A number of architec- 
ture designs have been proposed or suggested for ex- 
ploiting program parallelism. Generally, an architecture 
that can issue more than one operation at a time is ca- 
pable of executing a program faster than an architecture 35 
that can only issue one operation at a time. Most recent 
advances in computer architecture have been directed 
towards methods of issuing more than one operation at 
a time and thereby speed up the operation of programs. 
FIG. 1 illustrates a conventional microprocessor archi- *o 
tecture 100. Specifically, the microprocessor 100 in- 
cludes a program counter (PC) 110, a register set 120 
and a number of functional units (FUs) 130-N. The re- 
dundant functional units (FUs) 130-1 through 130-N pro- 
vide the illustrative microprocessor architecture 100 
with sufficient hardware resources to perform a corre- 
sponding number of operations in parallel. 
[0004] An architecture that exploits parallelism in a 
program issues operands to more than one functional 
unit at a time to speed up the program execution. A so 
number of architectures have been proposed or sug- 
gested with a parallel architecture, including supersca- 
lar processors, very long instruction word (VLIW) proc- 
essors and multithreaded processors, each discussed 
below in conjunction with FIGS. 2, 4 and 5, respectively. 55 
Generally, a superscalar processor utilizes hardware at 
run-time to dynamically determine if a number of oper- 
ations from a single instruction stream are independent, 



and if so, the processor executes the instructions using 
parallel arithmetic and logic units (ALUs). Two instruc- 
tions are said to be independent if none of the source 
operands are dependent on the destination operands of 
any instruction that precedes them. A very long instruc- 
tion word (VLIW) processor evaluates the instructions 
during compilation and groups the operations appropri- 
ately, for parallel execution, based on dependency in- 
formation. A multithreaded processor, on the other 
hand, executes more than one instruction stream in par- 
allel, rather than attempting to exploit parallelism within 
a single instruction stream. 

[0005] A superscalar processor architecture 200, 
shown in FIG. 2, has a number of functional units that 
operate independently, in the event each is provided 
with valid data. For example, as shown in FIG. 2, the 
superscalar processor 200 has three functional units 
embodied as arithmetic and logic units (ALUs) 230-N, 
each of which can compute a result at the same time. 
The superscalar processor 200 includes a front-end 
section 208 having an instruction fetch block 210, an in- 
struction decode block 21 5, and an instruction sequenc- 
ing unit 220 (issue block). The instruction fetch block: 
210 obtains instructions from an input queue 205 of a 
single threaded instruction stream. The instruction se- 
quencing unit 220 identifies independent instructions 
that can be executed simultaneously in the available 
arithmetic and logic units (ALUs) 230-N, in a known 
manner. The refine block 250 allows the instructions to 
complete, and also provides buffering and reordering for 
writing results back to the register set 240. 
[0006] In the program fragment 31 0 shown in FIG. 3, 
instructions in locations L1 , L2 and L3 are independent, 
in that none of the source operands in instructions L2 
and L3 are dependent on the destination operands of 
any instruction that precedes them. When the program 
counter (PC) is set to location L1 , the instruction se- 
quencing unit 220 will look ahead in the instruction 
stream and detect that the instructions at L2 and L3 are 
independent, and thus all three can be issued simulta- 
neously to the three available functional units230-N. For 
a more detailed discussion of superscalar processors, 
see, for example, James. E. Smith and<3urindar. S. So- 
hi, "The Microarchitecture of Superscalar Processors," 
Proc. of the IEEE (Dec. 1995), Incorporated by refer- 
ence herein. 

[0007] As previously indicated, a very long instruction 
word (VLIW) processor 400, shown in FIG4, relies on 
software to detect data parallelism at compile time from 
a single instruction stream, rather than using hardware 
to dynamically detect parallelism at run time. A VLIW 
compiler, when presented with the source code that was 
used to generate the code fragment 31 0 in FIG. 3, would 
detectthe instruction independence and construct a sin- 
gle, very long instruction comprised of all three opera- 
tions. At run time, the issue logic of the processor 400 
would issue this wide instruction in one-cycle, directing 
data to all available functional units 430-N. As shown in 
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FIG. 4, the very long Instruction word (VLIW) processor 
400 includes an Integrated fetch/decode block 420 that 
obtains the previously grouped Instructions 410 from 
memory. For a more detailed discussion of very long In- 
struction word (VLIW) processors, see, for example, 
Burton J. Smith, "Architecture and Applications of the 
HEP Multiprocessor Computer System," SPIE Real 
Time Signal Procesing IV, 241 -248 (1 981 ), incorporated 
by reference herein. 

[0008] One variety of VLIW processors, for example, 
represented by the Muttiflow architecture, discussed in 
Robert P. Colwell et al., "A VLIW Architecture for a Trace 
Scheduling Compiler," IEEE Transactions on Comput- 
ers (August 1988), uses a fixed-width instruction, in 
which predefined fields direct data to all functional units 
430-N at once. When all operations specified in the wide 
instruction are completed, the processor issues a new, 
multi-operation instruction. Some more recent VLIW 
processors, such as the C6x processor commercially 
available from Texas Instruments, of Dallas, TX and the 
EPIC IA-64 processor commercially available from Intel 
Corp, of Santa Clara, CA, instead use a variable-length 
instruction packet, which contains one or more opera- 
tions bundled together. 

[0009] A multithreaded processor 500, shown in FIG. 
5, gains performance improvements by executing more 
than one instruction stream in parallel, rather than at- 
tempting to exploit parallelism within a single instruction 
stream. The multithreaded processor 500 shown in FIG. 
5 includes a program counter 510-N, a register set 
520-N and a functional unit 530-N, each dedicated to a 
corresponding instruction stream N. Alternate imple- 
mentations of the multithreaded processor 500 have uti- 
lized a single functional unit 530, with several register 
sets 520-N and program counters 51 0-N. Such alternate 
multithreaded processors 500 are designed in such a 
way that the processor 500 can switch instruction issue 
from one program counter/register set 510-N/520-N to 
another program counter/register set 510-N/520-N in 
one or two cycles. A long latency instruction, such as a 
LOAD instruction, can thus be overlapped with shorter 
operations from other instruction streams. The TERA 
MTA architecture, commercially available from Tera 
Computer Company, of Seattle, WA, is an example of 
this type. 

[0010] An extension of the multithreaded architecture 
500, referred to as Simultaneous Multithreading, com- 
bines the superscalar architecture, discussed above in 
conjunction with FIG. 2, with the multithreaded designs, 
discussed above in conjunction with FIG. 5. For a de- 
tailed discussion of Simultaneous Multithreading tech- 
niques, see, for example, Dean Tullsen et al., "Simulta- 
neous Multithreading: Maximizing On-Chip Parallelism, 
" Proc. of the 22nd Annual Inn Symposium on Compu- 
ter Architecture, 392-403 (Santa Margherita Ligure, Ita- 
ly, June 1995), incorporated by reference herein. Gen- 
erally, in a Simultaneous Multithreading architecture, 
there is a pool of functional units, any number of which 



may be dynamically assigned to an instruction which 
can issuefrom any one of a number of program counter/ 
register set structures. By sharing the functional units 
among a number of program threads, the Simultaneous 
5 Multithreading architecture can make more efficient use 
of hardware than that shown in FIG. 5. 
[0011] While the combined approach of the Simulta- 
neous Multithreading architecture provides improved ef- 
ficiency over the individual approaches of the supersca- 
io lar architecture or the multithreaded architecture, Simul- 
taneous Multithreaded architectures still require elabo- 
rate issue logic to dynamically examine instruction 
streams in order to detect potential parallelism. A need 
therefore exists for a multithreaded processor architec- 
ts ture that does not require a dynamic determination of 
whether or not two instruction streams are independent. 
A further need exists for a multithreaded architecture 
that provides simultaneous multithreading. Yet another 
need exists for a multithreaded architecture that allo- 
20 cates functional units in such multithreaded processors 
in real-time. 

Summary of the invention 

25 [0012] Generally, a method and apparatus are dis- 
closed for allocating functional units in a multithreaded 
very large instruction word (VLIW) processor. The 
present invention combines the techniques of conven- 
tional very long instruction word (VLIW) architectures 
30 andconventionalmultithreadedarchitectures.Thecom- 
bined architecture of the present invention reduces ex- 
ecution time within an individual program, as well as 
across a workload. 

[0013] The present invention utilizes a compiler to de- 
35 tect parallelism in a multithreaded processor architec- 
ture. Thus, a multithreaded VLIW architecture is dis- 
closed that exploits program parallelism by issuing mul- 
tiple instructions, in a similar manner to single threaded 
VLIW processors, from a single program sequencer, 
40 and also supporting multiple program sequencers, as in 
simultaneous multithreading, but with reduced complex- 
ity in the issue logic, since a dynamic determination is 
not required. 

[001 4] The present invention allocates instructions to 
45 functional units to issue multiple VLIW instructions to 
multiple functional units in the same cycle. The alloca- 
tion mechanism of the present invention occupies a 
pipeline stage before arguments are dispatched to func- 
tional units. Generally, the allocate stage determines 
so how to group the instructions together to maximize effi- 
ciency, by selecting appropriate instructions, based on 
thread priorities or resource availability, or both, and as- 
signing the instructions to the functional units. 
[0015] The allocate stage selects the appropriate M 
55 instructions for execution from the (up to) N * K instruc- 
tions that were fetched and decoded in the pipeline. The 
criteria for instruction selection are thread priority or re- 
source availability or both . Under the thread priority cri- 
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teria, different threads can have different priorities. The 
allocate stage selects and forwards the packets (or in- 
structions from packets) for execution belonging to the 
thread with the highest priority according to the priority 
policy implemented. Under the resource availability cri- 5 
teria, a packet (having up to K instructions) can be allo- 
cated only if the resources (such as functional units) re- 
quired by the packet are available for the next cycle. 
Functional units report their availability to the allocate 
stage. 

[0016] A more complete understanding of the present 
invention, as well as further features and advantages of 
the present invention, will be obtained by reference to 
the following detailed description and drawings. 

Brief Description of the Drawings 

[0017] 

FIG. 1 illustrates a conventional generalized micro- 
processor architecture; 

FIG. 2 is a schematic block diagram of a conven- 
tional superscalar processor architecture; 
FIG. 3 is a program fragment illustrating the inde- 
pendence of operations; 

FIG. 4 is a schematic block diagram of a conven- 
tional very long instruction word (VLIW) processor 
architecture; 

FIG. 5 is a schematic block diagram of a conven- 
tional multithreaded processor; 
FIG. 6 illustrates a multithreaded VLIW processor 
in accordance with the present invention; 
FIG. 7A illustrates a conventional pipelinefor a mul- 
tithreaded processor; 

FIG. 7B illustrates a pipeline for a multithreaded 
processor in accordance with the present invention; 
and 

FIG. 8 is a schematic block diagram of an imple- 
mentation of the allocate stage of FIG. 7B. 

Detailed Description 

[0018] FIG. 6 illustrates a multithreaded VLIW proc- 
essor 600 in accordance with the present invention. As 
shown in FIG. 6, there are three instruction threads, 
namely, thread A (TA), thread B (TB) and thread C (TC), 
each operating at instruction number n. In addition, the 
illustrative Multithreaded VLIW processor 600 includes 
nine functional units 620-1 through 620-9, which can be 
allocated independently to any thread TA-TC. Since the 
number of instructions across the illustrative three 
threads TA-TC is nine and the illustrative number of 
available functional units 620 is also nine, then each of 
the instructions from all three threads TA-TC can issue 
their instruction packets in one cycle and move onto in- 
struction n+1 on the subsequent cycle. 
[0019] It is noted that there is generally a one-to-one 
correspondence between instructions and the operation 



specified thereby. Thus, such terms are used inter- 
changeably herein. It is further noted that in the situation 
where an instruction specifies multiple operations, it is 
assumed that the multithreaded VLIW processor 600 in- 
cludes one or more multiple-operation functional units 
620 to execute the instruction specifying multiple oper- 
ations. An example of an architecture where instructions 
specifying multiple operations may be processed is 
complex instruction set computer (CISC). 
[0020] The present invention allocates instructions to 
functional units to issue multiple VLIW instructions to 
multiple functional units in the same cycle. The alloca- 
tion mechanism of the present invention occupies a 
pipeline stage just before arguments are dispatched to 
functional units. Thus, FIG. 7A illustrates a conventional 
pipeline 700 comprised of a fetch stage 710, where a 
packet is obtained from memory, a decode stage 720, 
where the required functional units and registers are 
identified for the fetched instructions, and an execute 
stage 730, where the specified operations are per- 
formed and the results are processed. 
[0021] Thus, in a conventional VLIW architecture, a 
packet containing up to K instructions is fetched each 
cycle (in the fetch stage 71 0). Up to K instructions are 
decoded in the decode stage 720 and sent to (up to) K 
functional units (FUs). The registers corresponding to 
the instructions are read, the functional units operate on 
them and the results are written back to registers in the 
execute stage 730. It is assumed that up to three regis- 
ters can be read and up to one register can be written 
per functional unit. 

[0022] FIG. 7B illustrates a pipeline 750 in accord- 
ance with the present invention, where an allocate stage 
780, discussed further below in conjunction with FIG. 8, 
is added for the implementation of multithreaded VLIW 
processors. Generally, the allocate stage 780 deter- 
mines how to group the operations together to maximize 
efficiency. Thus, the pipeline 750 includes a fetch stage 
760, where up to N packets are obtained from memory, 
a decode stage 770, where the functional units and reg- 
isters are identified for the fetched instructions (up to 
N*K instructions), an allocate stage 780, where the ap- 
propriate instructions are selected and assigned to the 
FUs, and an execute stage 790, where the specified op- 
erations are performed and the results are processed. 
[0023] In the multithreaded VLIW processor 600 of 
the present invention, up to N threads are supported in 
hardware. N thread contexts exist and contain all pos- 
sible registers of a single thread and all status informa- 
tion required. A multithreaded VLIW processor 600 has 
M functional units, where M is greater than or equal to 
K. The modified pipeline stage 750, shown in FIG. 7B, 
works in the following manner. In each cycle, up to N 
packets (each containing up to K instructions) are 
fetched at the fetch stage 760. The decode stage 770 
decodes up to N*K instructions and determines their re- 
quirements and the registers read and written. The al- 
locate stage 780 selects M out of (up to) N*K instructions 
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and forwards them to the M functional units. It is as- 
sumed that each functional unit can read up to 3 regis- 
ters and write one register. In the execute stage 790, up 
to M functional units read up to 3*M registers and write 
up to M registers. 

[0024] The allocate stage 780 selects for execution 
the appropriate M instructions from the (up to) N * K in- 
structions that were fetched and decoded at stages 760 
and 770. The criteria for selection are thread priority or 
resource availability or both. Under the thread priority 
criteria, different threads can have different priorities. 
The allocate stage 780 selects and forwards the packets 
(or instructions from packets) for execution belonging to 
the thread with the highest priority according to the pri- 
ority policy implemented. A multitude of priority policies 
can be implemented. For example, a priority policy for 
a multithreaded VLIW processor supporting N contexts 
(N hardware threads) can have N priority levels. The 
highest priority thread in the processor is allocated be- 
fore any otherthread. Among threads with equal priority, 
the thread that waited the longest for allocation is pre- 
ferred. 

[0025] Under the resource availability criteria, a pack- 
et (having up to K instructions) can be allocated only if 
the resources (functional units) required by the packet 
are available for the next cycle. Functional units report 
their availability to the allocate stage 780. 
[0026] FIG. 8 Illustrates a schematic block diagram of 
an implementation of the allocate stage 780. As shown 
in FIG. 8, the hardware needed to implement the allo- 
cate stage 780 includes a priority encoder 810 and two 
crossbar switches 820, 830. Generally, the priority en- 
coder 81 0 examines the state of the multiple operations 
in each thread, as well as the state of the available func- 
tional units. The priority encoder 81 0 selects the packets 
that are going to execute and sets up the first crossbar 
switch 820 so that the appropriate register contents are 
transferred to the functional units at the beginning of the 
next cycle. The output of the priority encoder 81 0 con- 
figures the first crossbar switch 820 to route data from 
selected threads to the appropriate functional units. This 
can be accomplished, for example, by sending the reg- 
ister identifiers (that include a thread identifier) to the 
functional units and letting the functional units read the 
register contents via a separate data network and using 
the crossbar switch 81 0 to move the appropriate register 
contents to latches that are read by the functional units 
at the beginning of the next cycle 
[0027] Out of the N packets that are fetched by the 
fetch stage 760 (FIG. 7B), the priority encoder 810 se- 
lects up to N packets for execution according to priority 
and resource availability. In other words, the priority en- 
coder selects the highest priority threads that do not re- 
quest unavailable resources for execution. It then sets 
up the first crossbar switch 810. The input crossbar 
switch 61 0 routes up to 3K*N inputs to up to 3*M outputs. 
The first crossbar switch 810 has the ability to transfer 
the register identifiers (or the contents of the appropriate 



registers) of each packet to the appropriate functional 
units. 

[0028] Since there are up to N threads that can be se- 
lected in the same cycle and each thread can issue a 

s packet of up to K instructions and each instruction can 
read up to 3 registers there are 3K*N register identifiers 
to select from. Since there are only M functional units 
and each functional unit can accept a single instruction, 
there are only 3M register identifiers to be selected. 

10 Therefore, the crossbar switch implements a 3K # N to 
3M routing of register identifiers (or register contents). 
[0029] The output crossbar switch 830 routes M in- 
puts to N*M or N*K outputs. The second crossbar switch 
830 is set up at the appropriate time to transfer the re- 

15 suits of the functional units back to the appropriate reg- 
isters. The second crossbar switch 830 can be imple- 
mented as a separate network by sending the register 
identifiers (that contain a thread identifier) to the func- 
tional units. When a functional unit computes a result, 

20 the functional unit routes the result to the given register 
identifier. There are M results that have to be routed to 
up to N threads. Each thread can accept up to K results. 
The second crossbar switch 830 routes M results to NTK 
possible destinations. The second crossbar switch 830 

25 can be implemented as M buses that are connected to 
all N register files. In this case, the routing becomes M 
results to N*M possible destinations (if the register files 
have the ability to accept M results). 
[0030] It is to be understood that the embodiments 

30 and variations shown and described herein are merely 
illustrative of the principles of this invention and that var- 
ious modifications may be implemented by those skilled 
in the art without departing from the scope and spirit of 
the invention. 

35 

Claims 

1 . A multithreaded very large instruction word (VLIW) 
40 processor, comprising: 

a plurality of functional units for executing a plu- 
rality of instructions from an instruction stream 
having a plurality of threads, said threads hav- 

45 ing a priority; and 

an allocator that selects instructions from said 
instruction stream and forwards said instruc- 
tions to said plurality of functional units, said al- 
locator selecting said instructions based on 

50 said thread priority. 

2. The multithreaded very large instruction word 
(VLIW) processor of claim 1 , wherein said thread 
priority allows different threads to have different pri- 

55 orities. 

3. The multithreaded very large instruction word 
(VLIW) processor of claim 1 , wherein said allocator 
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selects and forwards said instructions for execution 
belonging to the thread with the highest priority. 

4. The multithreaded very large instruction word 
(VLIW) processor of claim 1 , wherein said allocator s 
selects and forwards said instructions based on 
said thread priority and on a resource availability. 

5. A multithreaded very large instruction word (VLIW) 
processor, comprising: 10 

a plurality of f u nctionai units for executing a plu- 
rality of instructions from a multithreaded in- 
struction stream; and 

an allocator that selects instructions from said *5 
instruction stream and forwards said instruc- 
tions to said plurality of functional units, said al- 
locator selecting said instructions based on re- 
source availability. 

20 

6. The multithreaded very large instruction word 
(VLIW) processor of claim 5, wherein said resource 
availability allows said instructions to be allocated 
only if the resources required by the instructions are 
available for the next cycle. 25 

7. The multithreaded very large instruction word 
(VLIW) processor of claim 5, wherein said resourc- 
es comprise said functional units. 

30 

8. The multithreaded very large instruction word 
(VLIW) processor of claim 5, wherein said allocator 
selects and forwards said instructions based on 
said resource availability and on a priority assigned 

to said threads. 35 

9. A method of processing instructions from an in- 
struction stream having a plurality of threads in a 
multithreaded very large instruction word (VLIW) 
processor, comprising the steps of: *o 

executing said instructions using a plurality of 
functional units, said threads having a priority; 
selecting instructions from said instruction 
stream based on said thread priority; and *s 
forwarding said selected instructions to said 
plurality of functional units. 

10. The method of claim 9, wherein said thread priority 
allows different threads to have different priorities, so 

11 . The method of claim 9, wherein said selection step 
selects said instructions for execution belonging to 
the thread with the highest priority. 

55 

12. A method of processing instructions from an in- 
struction stream having a plurality of threads in a 
multithreaded very large instruction word (VLIW) 



processor, comprising the steps of: 

executing said instructions using a plurality of 
functional units; 

selecting instructions from said instruction 
stream based on resource availability; and 
forwarding said selected instructions to said 
plurality of functional units. 

13. The method of claim 12, wherein said resource 
availability allows said instructions to be allocated 
only if the resources required by the instructions are 
available for the next cycle. 

14. The method of claim 12, wherein said resources 
comprise said functional units. 

15. An article of manufacture for processing instruc- 
tions from an instruction stream haying a plurality 
of threads in a multithreaded very large instruction 
word (VLIW) processor, comprising: 

a computer readable medium having compu- 
ter readable program code means embodied ther- 
eon, said computer readable program code means 
comprising program code means for causing a com- 
puter to: 

execute said instructions using a plurality of 
functional units, said threads having a priority; 
select instructions from said instruction stream 
based on said thread priority; and 
forward said selected instructions to said plu- 
rality of functional units. 

16. An article of manufacture for processing instruc- 
tions from an instruction stream having a plurality 
of threads in a multithreaded very large instruction 
word (VLIW) processor, comprising: 

a computer readable medium having compu- 
ter readable program code means embodied ther- 
eon, said computer readable program code means 
comprising program code means for causing a com- 
puter to: 

execute said instructions using a plurality of 
functional units; : 

select instructions from said instruction stream 
based on resource availability; and 
forward said selected instructions to said plu- 
rality of functional units. 
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their availability to the allocate stage. 
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